Papers by David Demitri Africa
Batayan: A Filipino NLP benchmark for evaluating Large Language Models (2025.acl-long)
Copied to clipboard
Jann Railey Montalan, Jimson Paulo Layacan, David Demitri Africa, Richell Isaiah S. Flores, Michael T. Lopez Ii, Theresa Denise Magsajo, Anjanette Cayabyab, William Chandra Tjhi
| Challenge: | Recent advances in large language models (LLMs) have demonstrated remarkable capabilities on widely benchmarked high-resource languages. |
| Approach: | They propose a benchmark that systematically evaluates LLMs across three key natural language processing competencies: understanding, reasoning, and generation. |
| Outcome: | The proposed benchmark covers eight tasks covering Tagalog and code-switched Taglish utterances. |
Pico: A Modular Framework for Hypothesis-Driven Small Language Model Research (2025.emnlp-demos)
Copied to clipboard
Richard Diehl Martinez, David Demitri Africa, Yuval Weiss, Suchir Salhan, Ryan Daniels, Paula Buttery
| Challenge: | Recent advances in large language models (LLMs) have enabled strong performance across diverse tasks, but small enough to train on modest budgets. |
| Approach: | They propose a lightweight, modular framework that enables systematic, hypothesis-driven research for small and medium-scale language model development. |
| Outcome: | The proposed framework enables systematic, hypothesis-driven research for small and medium-scale language model development. |